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Abstract 

This paper analyzes a class of impulse control problems for multi-dimensional jump diffusions in a 
finite time horizon. Following the basic mathematical setup from Stroock and Varadhan [33] ■ this 
paper first establishes rigorously an appropriate form of Dynamic Programming Principle (DPP). It 
then shows that the value function is a viscosity solution for the associated Hamilton- Jacobi-Belleman 
(HJB) equation involving integro-differential operators. Finally, it proves the p regularity for 

2 < p < oo and the uniqueness of the viscosity solution. 

Keywords: Stochastic Impulse Control, Viscosity solution, Parabolic Partial Differential Equations 
AMS Classification: 49J20, 49N25, 49N60 

1 Introduction 

This paper considers the following class of impulse control problem for an n-dimensional diffusion process 
X t . In the absence of control, X t is governed by an Ito's stochastic differential equation, 



X t =x + f b(X s _,s)ds + f a(X s ^,s)dW s 

t r ft 



+ ji(X a -,a,z)N(dz,dt)+ / j 2 {X s _,s,z)N(dz,dt), 

J t J J t 



where W is a standard Brownian motion, N = N(dt, dz) — p(dz)dt with N being a Poisson point process 
on [0,T] x R fc with density p(dz)dt, W and N are independent in an appropriate filtered probability 
space (0, J", P), and b, a, j\, j% satisfy suitable regularity conditions to be specified later. If a control 
policy V = (ti, £i;T2, £2; • • •) is adopted, then X t evolves as 

X t =x Q + f b(X„-,s)ds+ f a(X s ^,s)dW s +Y,^ 1 (r l <t) 

Jto Jto 4 

+ / f ji(X 3 -,s,z)N(dz,dt)+ f f j 2 (X s _,s,z)N(dz,dt). 

J to J <1 to <* 



Here the control (Tj,£j)j is of an impulse type such that ti,T2, . . . is an increasing sequence of stopping 
:mes 

J-^' N -measurable random variable. 



times with respect to J-^ N , the natural filtration generated by W and N, and is an R"-valued, 
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The objective is to choose an appropriate impulse control (Tj,£j)j so that the following cost function 
is minimized: 



J[x ,to,Ti,£i] =E 



f T f ( X *o,to,r t ,U it)dt + J- B&, n )l {t0<n<T} + g{X^^) 

J to i 



Here / : E" x [0,T] -> E is the running cost function, B : E" x [0,T] -> M n is the transaction cost 
function, and g : E™ x E is the terminal cost function. 

Impulse control, in contrast to regular and singular controls, allows the state space to be discontinuous 
and is a more natural mathematical framework for many applied problems in engineering and economics. 
Examples in financial mathematics include portfolio management with transaction costs [3] [23] [TTJ 
|2"TI |2"D] , insurance models [ID] U\ , liquidity risk [25] , optimal control of exchange rates [2DJ HH1 H] , and 
real options [351126) . Similar to their regular and singular control counterparts, impulse control problems 
can be analyzed via various approaches. One approach is to focus on solving for the value function 
the associated (quasi)-variational inequalities or Hamilton- Jacobian-Bellman (HJB) integro-differential 
equations, and then establishing the optimality of the solution by a verification type theorem. (See 
0ksendal and Sulem [3D].) Another approach is to characterize the value function of the control problem 
as a (unique) viscosity solution to the associated PDEs, and/or to study their regularities. In both 
approaches, in order to connect the PDEs and the original control problems, a proper form of the 
Dynamic Programming Principle (DPP) is usually implicitly or explicitly assumed. 

The earliest mathematical literature on impulse controls is the well-known book by Bensoussan and 
Lions [3j , where value functions of the control problems for diffusions without jumps were shown to be 
the solutions of quasi- variational-inequalities and where their regularity properties were established when 
the control is strictly positive and the state space is in a bounded region. Recently, Barles, Chasseigne, 
and Imbert [T] provided a general framework and careful analysis on the unique viscosity solution of 
second order nonlinear elliptic/parabolic partial integro-differential equations. However, their paper did 
not study the DPP, i.e., the link between the PDEs and control problems. On the other hand, Tang 
and Yong [33] and Ishikawa [TS] established some version of the DPP and the uniqueness of the viscosity 
solution for diffusions without jumps. More recently, Seydel [35] used a version of the DPP for Markov 
controls to study the viscosity solution of control problems on jump diffusions. Based on the restrictive 
setup of [32], Davis, Guo and Wu [TDJ focused on the regularities of the viscosity solution associated 
with the control problems on jump diffusions in an infinite time horizon. Their results used some of the 
techniques developed in Guo and Wu [T7] . 

In essence, there are three aspects when studying impulse control problems: the DPP, the HJB, 
and its regularity. However, all previous work addressed only one or two of the above aspects and used 
quite different setups and assumptions, making it difficult to see exactly to what extent all the relevant 
properties hold in a given framework. This is the motivation of our paper. 



Our Results. This paper studies the finite time horizon impulse control problem of Eqn. @ on 
multi-dimensional jump diffusions of Eq. ([I]). 

• First, we follow the classical setup of Stroock and Varadhan [33] and work on the natural filtration 
of the underlying Brownian motion and the Poisson process, instead of the "usual hypothesis" , 
i.e., the completed right continuous filtration adopted in previous work. Within this framework 
and based on the estimation techniques developed in Tang and Yong [33] for diffusion processes 
without jumps, we prove a general form of the DPP. 

We remark that various forms of the DPP for impulse controls of jump diffusions have been exploited 
quite literally in the stochastic control literature, and their proofs can be found for several cases, 
yet not with the full generality needed in this paper. For instance, our result includes those in |34) 
and [35] as special cases and includes non-Markov controls. Because of the inclusion of the jumps in 
the diffusion processes and the possibility of non-Markov controls, there are essential mathematical 
subtlety and difficulties, hence the necessity to adopt the classical and framework of [33]. This 
framework ensures certain properties of the regular conditional probability, and ensures that the 
controlled jump diffusions are well defined. These properties are crucial for rigorously establishing 
the DPP. In a way, our approach to the DPP is in the similar spirit of Yong and Zhou [3D] for 
one-dimensional regular controls. 
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Note that there are separate lines of research on the DPP, including the weak DPP formulation 
by Bouchard and Touzi [5] and Bouchard and Nutz [5], as well as the classical work by El Kaouri 
12J. However, it docs not seem easy for us to fit their results to our problem and setup. 

• Second, we show that the value function is a viscosity solution in the sense of pQ. This form of 
viscosity solution is convenient for the HJB equations involving integro-differential operators, which 
is the key for analyzing control problems on jump diffusions. 

Closely related to our work in this aspect are the works of [32] and [31]. The former allowed only 
Markov controls and the latter did not deal with jump diffusions. 

• Third, we prove the W^^ ,p regularity and the unique viscosity solution properties for the value 
function with first-order jumps. Note that the uniqueness of the viscosity solution in our paper is 
a "local" uniqueness, which is appropriate to study the regularity property. 

Compared to 10 for an infinite horizon problem, this paper is on a finite time horizon which 
requires different PDEs techniques. Moreover, [10] did not study the DPP, nor the uniqueness 
of the viscosity solution, and was restricted to Markov controls. Thus it built partial results in 
a restrictive setting. There were also studies by Xing and Bayraktar [2] and Pham [3Tj on value 
functions for optimal stopping problems for jump diffusions. Their work however did not involve 
controls. 

To our best knowledge, our paper is the first that presents a comprehensive analysis for impulse 
control problems for jump diffusions: from the original control problem, to the related DPP, to the 
viscosity solution, and its uniqueness and regularity; all established under one mathematical setup. 



2 Problem Formulation and Main Results 
2.1 Problem formulation 

Filtration Fix a time T > 0. For each to G [0, T], let (f2, T , P) be a probability space that supports 
a Brownian motion {W. }t < s <T starting at to, and an independent Poisson point process N(dt,dz) on 
( [to , T] , M fc \ {0}) with intensity L ® p. Here L is the Lebesgue measure on [io>7l and p is a measure 
defined on R fe \{0}. For each t G [t ,T], define {jf ' N } to <t<T to be the natural filtration of the Brownian 
motion W and the Poisson process N, define {F to ,t[to, T}} to be {J^' N }t a <t<T restricted to the interval 
[to,*]- 

Throughout the paper, we will use this uncompleted natural filtration {J~t ,t[to, T]}. This specification 
ensures that the stochastic integration and therefore the controlled jump diffusion to be well defined. 
(See Lemma 4.3.3 from Stroock & Varadhan [33]). 

Now, we can define mathematically the impulse control problem, starting with the set of admissible 
controls. 

Definition 1. The set of admissible impulse control V [to, T] consists of pairs of sequences {Tj,£j}i<j<oo 
such that 

1. Ti : ft — > [to,T] U {oo} such that r, are stopping times with respect to the filtration {J-" to '^}t <s<T, 

2. T{ < Tj+i for all i, 

3. £j : ft — > 1" \ {0} is a random variable such that £j G J-^'^ . 
Now, given an admissible impulse control {t^, ^i}i<i<c>oi 

a stochastic process (X t )t>o follows a stochas- 
tic differential equation with jumps, 

X t =xo+ f b(X s -,s)ds+ [ o-(X s -,s)dW s +Y,tikn<t) 

Jt Jtg i 

+ [ [ j 1 (X s _,s,z)N{dz,dt)+ [ f j 2 (X s _,s,z)N(dz,dt), (1) 

J t Q J J t J 
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Here N = N(dt, dz) - p(dz)dt, b:W l x [0, T] x E n , a : R" x [0, T] -> R nxm , and ji, j 2 : x [0, T] 
R™. For each (n,^ E V[i ,T], and (aj ,*o) £i"x [io,T], denote X = X to ' Xo ' u ' Ti '^ . 
The stochastic control problem is to 

(Problem) Minimize J[xo,to,Ti,£i] over all (tj, £j) S V[t, T], 

subject to Eqn. JlJ with 

T 

'to 

Here we denote for the associated value function 



J[x ,to,Ti,£i\ = E 



E 



^2 B (£i,n)i{t <n<T} 



(3) 



(Value Function) V(x,i) = inf J[x, i, Tj, (4) 

(r„ii)eV[t,T] 

In order for J and V to be well defined, and for the Brownian motion W and the Poisson process N 
as well as the controlled jump process X x ° :to,Ti ^ i to be unique at least in a distribution sense, we shall 
specify some assumptions in Section [2.21 

The focus of the paper is to analyze the following HJB equation associated with the value function 



(HJB) 



max{-u t + Lu - f - Iu, u - Mu} = in R" x (0,T), 
u = g on R™ x {t = T}. 



Here 



I(j)(x,t) = J </)(x + ji(x,t, z),t) — 4>{x,t)p{dz) 

+ j 4>(x + j 2 (x,t,z),t) - <j){x,t) - D<f>(x,t) ■ j 2 (x,t,z)p(dz), (5) 

Mu{x, t) = inf (u(x + £,*) + B(€, t)), (6) 

Lu(x, t) = -tr [A(x, t) ■ D 2 u(x, t)] - b(x, t) ■ Du(x, t) + ru(x, t). (7) 

Main result. Our main result states that the value function V(x,t) is a unique w/„ P (K" x (0,T)) 
viscosity solution to the (HJB) equation with 2 < p < oo. In particular, for each t £ [0, T), V(-,t) G 
C^2(M. n ) for any < 7 < 1. 

The main result is established in three steps. 

• First, in order to connect the (HJB) equation with the value function, we prove an appropriate 
form of the DPP. (Theorem HJ). 

• Then, we show that the value function is a continuous viscosity solution to the (HJB) equation in 
the sense of pQ. (Theorem [2]) . 



• Finally, we show that the value function is Wi oc ' for 2 < p < oo, and in fact a unique viscosity 



r(2,l),P 

i, 

solution to the (HJB) equation. (Theorem [5]). 
All results, unless otherwise specified, are built under the assumptions specified in Section |2~2"1 

2.2 Outstanding assumptions 
Assumption 1. Given to < T, assume that 

(O io , T ,7-,{7- to!t [to,T]} io < 4 < T ) =(C[t ,T] x M[t ,T], 

B to , T [to,T]® M to , T [h,T], 
{B to , t [t ,T}®M to Ato,T}} to < t < T ) 
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such that the projection map (W, N)(x.,n) — (x.,n) is the Brownian motion and the Poisson point process 
with density p(dz) x dt under P, and for to < s < t < T , 

C[t ,T] ={x. : [t ,T] ->R n , Xto = 0}, 

M[to,T] —the class of locally finite measure on [to,T] x M fe \ {0}, 
B Slt [to,T\ =a({x r : x. £ C[t ,T],s < r < t}), 
M s ,t[t ,T] =*({n(B) : B £ B([s,i\ x M fe \ {0}), n £ M[t ,T}}). 

Assumption 2. (Lipschitz Continuity.) The functions b, a, and j are deterministic measurable func- 
tions such that there exists constant C independent of t S [to,T], z £ R k \ {0} such that 

\b(x,t)-b(y,t)\<C\x-y\, 
W(x,t) - a(y,t)\ < C\x - y\, 

/ \h(x,t,z) - j!(x,t,z)\p(dz) < C\x - y\, 

J\z\>l 

/ \h{x,t,z) - j 2 (x,t,z)\ 2 p(dz) < C\x - y\ 2 . 

J\z\<l 

Assumption 3. (Growth Condition.) There exists constant C > 0, v £ [0,1), such that for any 
x,yeR n , 

\b(t, X )\ <L(i+\ x n, 

\a(t,x)\ <L(l + |xr/ 2 ), 
f \h{x,t,z)\v{dz)<C{l + \x\ v ), 

J\z\>l 

[ \ ]2 {x,t,z)\ 2 v{dz)<C{l + \x\ v ). 

J\z\<l 

Assumption 4. (Holder Continuity.) f : [0, T] x M™ x R and g : R" — > R are measurable functions such 
that there exists C > 0, 5 £ (0, 1], 7 £ (0, 00) such that 

\f(t,x) - f(t,x)\ < C(l + \x\"> + \xp)\x - x\ 5 , 
\g(x) - g(x)\ < (7(1 + \x\"> + \x\i)\x - x\ 5 , 

for all t £ [0,T], x,x € R™. 

Assumption 5. (Lower Boundedness) There exists an L > and p £ (0, 1] such that 

f(t,x)>-L, 
h(x) > — L, 
Bfot) >L + CW, 

for all t £ [0,T], x £ R", £ £ M™. 

Assumption 6. (Monotonicity and Subadditivity) B : R" x [0,T] — >• R is a continuous function such 
that for any < s < t < T, B(t 7 £) < B(s 7 £), and for being in a fixed compact subset of 

R" x [0,T), there exists constant K > such that 

B(t,Z + £)+K<B(t,£)+B(t,i). 

Assumption 7. (Dominance) The growth of B exceeds the growth of the cost functions f and g so that 

(5 + 7 <p, 
v <p. 
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Assumption 8. (No Terminal Impulse) For any x,£ G R™, 

g(x)<m{g(x + + B(t,T). 

Assumption 9. Suppose that there exists a measurable map M : R™ x [0,T] — > M(R™ \ {0}) 7 m w/iic/i 
Af(R™\{0}) is £/ie set of locally finite measure on R™\{0}, such that one has the following representation 
of the integro operator: 



I<j>(x, t) = J [<f>(x + z,t)- 4>{x, t) - D(f>(x, t) ■ zl\ z \< 1 ]M(x, t, dz). 
And assume that for (x,t) in some compact subset o/R" x [0,T], there exists C such that 

[ \z\ 2 M(x,t,dz)+ [ \zp +s M(x 7 t,dz) <C. 

J\z\<l J\z\>l 

Notations Throughout the paper, unless otherwise specified, we will use the following notations. 

• < a < 1. 

A(x,t) = (aij) nxn (x,t) = -a(x,t)a(x,t) T . 

• E(x,t) is the set of points £ for which MV achieves the value, i.e., 

S(x, t) = {£ G R" : MV(x, t) = V(x +£,t) + B(£, t)}. 

• The continuation region C and the action region A are 

C := {(x, t) G R" x [0, T] : V(x, t) < MV(x, t)}, (8) 
A := {(x, t) G R n x [0, T] : V(x, t) = MV(x, t)}. (9) 

• Let be a bounded open set in R n+1 . Denote dpfl to be the parabolic boundary of f2, which is the 
set of points (x ,t ) G SI such that for all R > 0, Q(x ,t n ; R) ft. Here Q(x ,t ; R) = {(x, t) G 
R" +1 : max{\x-x \, |i-i | 1/2 } < R,t < t }. 

Note that O is the closure of the open set in R" +1 . In the special case of a cylinder, O = 
Q(x , t a ; R), the parabolic boundary d P tt = (B(0, R) x {t = 0}) U ({\x\ = R} x [0, T]). 

• Function spaces for f2 being a bounded open set, 

W^' P (Q) = {u£ L p (fl) : u Xi G L p (n)}, 
W^ p (O) = G : u XiXj G 

C^(n) = {u G : u u u XiXj G C(fi)}, 

f (fi) = {« G C(O) : sup - HX ^-; {V ^ /2 < oo}, 

C-2+a.l + f (Q) = {u g . „ XiXj)Ut g C 0+a '° + ^(r2)}, 

L L( fi ) = {"lu € i p (t/) Vopcn f7 such that U C Q\ <9 P ft}, 

W^ 0) ' P (n) = {u G L p oc (n) : u G W^' P {U) Vopen U such that U C f2 \ d P ft}, 

^/ o 2 c' 1) ' P ( ) = G Lfcjft) : u G W^ 2 ' 1 ^!/) Vopen U such that 17 C H \ 9 P ^}. 
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3 Dynamic Programming Principle and Some Preliminary Re- 
sults 



3.1 Dynamic Programming Principle 

Theorem 1. (Dynamic Programming Principle ) Assuming (Al), (A2), (A3), (A4), and (A5). For 
to G [0,T], xq G W l , let t be a stopping time on (tt to ,T, {J~t .t}t), we have 



V(t ,x ) = inf E 



■AT 



+E 



/(s,X*°' X0 ' Ti ^ i )ds 



(10) 



In order to establish the DPP, the first key issue is: given a stopping time r, how the martingale 
property and the stochastic integral change under the regular conditional probability distribution (P| J>). 
The next key issue is the continuity of the value function, which will ensure that a countable selection is 
adequate without the abstract measurable selection theorem. (See [H]). 

To start, let us first introduce a new function that connects two Brownian paths which start from the 
origin at different times into a single Brownian path. This function also combines two Poisson measures 
on different intervals into a single Poisson measure. 

Definition 2. For eacht 6 [t 0l T], define a map 11* = II|) : C[t , T] x M [t , T] -> C[t ,t]xM[t ,t]x 
C[t,T] x M[t,T] such that 

IL\(x.,n) =(#|[t 0>t ],n|[t , t ]x B fc\{o}), 
IT|(ar.,n) =(x\[t,T] - xt,n\(t,T]xn*\{0})- 

Note that this is an !Ft 0t T\t[),T]l 'Ft ,t[to,i\ ® J~t,T[t, Immeasurable bijection. Therefore, for fixed 
(y.,m) G C[t ,T] x M[t ,T],\he map from C[t,T] xM[t, T] -)• C[t ,T] x M[t ,T] defined by 

(x.,n) H>(n*)- 1 (n*(i,. ) m),l4(a;.,n)) 

= {x. yt —X t + V-At, m l[t o ,t]xR fc \{0} + n \(t,T]xR k \{0}) 

is Tt, s [t, T]/Tt ,s[to, T]-measurable for each s G [t,T]. 

Next, we need two technical lemmas regarding (P|J>). Specifically, the first lemma states that the 
local martingale property is preserved, and the second one ensures that the stochastic integration is well 
defined under (P|J>). 

According to Theorem 1.2.10 of 33 , 

Lemma 1. Given a filtered space, (f2, J-, {.Ft}o<t<T, P)> and an associated martingale {M t }o<t<T- Let 
t be an T -stopping time. Assume (P|J>) exists. Then, for P-a.e. lo G Q, N t — M t — M t/ \ T is a local 
martingale under (P|J>)(w, •). 

Lemma 2. Given a filtered space (f2, T, {J c t}o<t<T, P), a stopping time t, a previsible process H : 
(0, T] x fl -> R n , a local martingale M : [0, T] x fl ^ R n such that 



J \H s \ 2 d[M] s < oo 



P-almost surely, and N t = ^H s dM s (a version of the stochastic integral that is right- continuous on all 

paths). Assume that (P|J>) exists. Then, for P-a.e. uj G Q, N t is also the stochastic integral J* H s dM s 
under the new probability measure (¥\Q)(u>, ■). 

The proof is elementary and is listed in the Appendix for completeness. 
Now, we establish the first step of the Dynamic Programming Principle. 
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Proposition 1. Let t be a stopping time defined on some setup (O, {J"t , s })- impulse control 

(Ti,Zi)eV[t ,T], 



J[t ,x ,Ti,£i] =E 



-AT 



+ E[j[rAr,X*^ : rr ^,rr,^ j 
ifere 7f,£f are denned as /ol/otus. f or ^ e [*o,T], /or eac/i (y.,m) G C[t ,T] x M([t ,T] xR l \ {0}),, 

g^O^n) =6((nrWi(y-,"),n<(x.,n))). 

>lnd /or eac/i w, 

u _ t(u),W.{u),N(u) 
t&i = /-t(u)),W.(w),JV(u) 

Proof. Consider (P|J-"t ^ r ) on (n to _t, {J~t ,t})- Since we are working with canonical spaces, the sample 
space is in fact a Polish space (see [3T] Theorem A2.1 and A2.3), and the regular conditional probability 
exists by Theorem 6.3 of [3T]. Since Polish spaces are completely separable metric spaces and have 
countably generated c-algebra, Tt a>r is countably generated. By Lemma 1.3.3 from Stroock & Varadhan 
[33] . there exists some null set No such that if (x.,ri) ^ No, then 



(11) 



(P\T t0 , T )((x.,n),{(y.,n) :U T 1 ( - x - n \y.,n) = Ul {x - 



\x.,n)}) = l. 



Therefore, for ui — (x.,n) ^ N n , Ti — t", and & = almost surely. 

Moreover, by Lemma [3J the stochastic integrals are preserved. Therefore, for uj £ No, the solution to 
Eq. (JT|) remains a solution to the same equation on the interval [t{uj),T] with (r^,^f) G V[t(oj),T], So 
X*o.*o,T«,fc on the interval [r(w),T] has the same distribution as X T ^' V > T ?>& for y = A* ^* '" " n ' s< (w) 
under (P|J" t T )(w, •) for u <£ N . □ 



Now, to obtain the Dynamic Programming Principle, one needs to take the infimum on both sides 
of Eq. (fTTj) . The part of "<" is immediate, but the opposite direction is more delicate. At the stopping 
time t, for each oj, one needs to choose a good control so that the cost J is close to the optimal V. To 
do this, one needs to show that the functional J is continuous in some sense, and therefore a countable 
selection is adequate. 

The following result, the Holder continuity of the value function, is essentially Theorem 3.1 of Tang 
& Yong [34] . The major difference is that their work is for diffusions without jumps, therefore some 
modification in terms of estimation and adaptedness are needed, as outlined in the proof. 

Lemma 3. There exists constant C > such that for all t,t £ [0, T], x, x G K n , 

-C(T + 1) <V(t, x) < C(l + \x\' f+s ), 

\v{t,x) - v(i, x)\ <c[(i + \ x \» + \in\t - i\ & ' 2 + (i + \ x y + \ x y)\x - x\ 5 ]. 

Proof. To include the jump terms, it suffices to note the following inequalities, 



E 



E 



j 1 (s,X s ,z)N(dz,ds) 



j 2 {s,X s ,z)N(dz,ds) 



<E 



<E 



\ji(s,X 3 , z)\p(dz)ds 



\j 2 (s,X s , z)\ 2 p(dz)ds 



0/2 



Moreover, in our framework, £(•) and £(•) would not be in V[i, T] because it is adapted to the filtration 
{J r t V s N }i<s<T instead of }{< s <t- To fix this, consider for each w G fit 0l Tj 

T(-) KKn'rHnfH^^-))), 
T(-) ^((nr^niH, n* (■))), 
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and consequently use E [J[i, x, instead of J[i,x,u.,£\. 

Given that the value function V is continuous, we can prove Theorem [T] 
Proof. (Dynamic Programming Principle) Without loss of generality, assume that t <T. 



□ 



J[t ,XQ,Ti,£i] =E 



>E 



f f(s,Xi°- x °)ds + J2B(n,mn<T 
J to 



E 



J[T,X T _ ,U. ,Tj ,£ 



f(s,X, 



to 



■E 



to,Xo,T?,£t 



Taking infimum on both sides, we get 



V(ta,xo)> inf E 



J to 



to^OiT-j'iSi 



Now we are to prove the reverse direction for the above inequality. 

Fix e > 0. Divide W l x [to,T) into rectangles {Rj x [sj,t,)} disjoint up to boundaries, such that for 
any x, x G -Rj and t, f G [sj, t,), 

|V(a:,f)-V(z,t)l <e, 
diam(Rj) <e. 

For each pick Xj G For each (xj,tj), choose v? G U[tj,T}, (t^,^) G V[tj,T], such that 

V(a; J -,t i ) + e> J[x,, rf , ^']. Let 

Note that {^4j}j partitions the sample space C[to,T] x M[t 0l T\. Define a new stopping time f by: 

f = tj on j4j . 

Note that f > r unless t = T. 

Define a new strategy (fj,£i) G V[to,T] by the following, 



Ei 1 J Si Cilri<t 



if t < r, 

EijUMK^di^^N)) if Or. 



In other word, once r is reached, the impulse will be modified so that there would be no impulses on 
[r, f), and starting at f , the impulse follows the rule (rf , £f ) on the set Aj. Now we have, 



V(t ,X ) < J[t ,X ,Ti,£i 



=E 



=E 



in 



5 ' i ) 



/(SiX io,,o,n^ ))df 



■E 



'2 'Si 

^B(t 4 ,&)1 7 



E 
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The last equality follows from the fact that, f, is cither < r, or > f, so fj < f implies that fj = Tj < r. 
Since ti u = ^(n-^nf iV(w)), n 2 (-))) = on the set Aj, 



V(t ,x ) <E 

+ E 



Jtn 



+ E 



+ E 



<E 



/' 



+ E 



+ E 



X>(7i,&)lT ( 



+ E 



£ f(s,Xi°' x °^))ds 



+ e. 



Now, for the second term in the last expression, we see 



E 



<E 



<E 



^ r c(i + |x s p+ 5 )& 

^ C(1+E W |X S -X r |T +,5 + |X r |T +,5 )rfs 
y C(l + \X T \")ds <E E" y C(l + |X T |^)rfs 



<E[eC(l + |X r H] ^Cea + larol"). 
Therefore, it suffices to bound the following expression, 



(12) 



E 



Y^Vit^Xl .^ ^) - V(r,X t T °l Xo - u ' T ^)}l Aj 



First, note that on the interval [t, f), X = X to ' Xo ' u ' n '^ i solves the jump SDE with no impulse: 

r t/\T r t/\T 



XtAT — X T 



/CAT rtAT 
b{s,X s )dt+ / a{s,X s )dW 

r tAr f 

j(s, X s ,z)N(dz, ds) 



o<lil<i 



+ / / j(s,X s ,z)N(dz,ds). 

Jr Jl<\j\ 



In particular, under (P|(J"°) t „f ), r, X* '* '^* and f are all deterministic, hence the following estimates 



1 1 

r o\W,N 



E('I^C")H|X f(w) |^<C(l + |X r(w /), 
E W»|j: f(B) - X r(w / <C(1 + |X T(w /)(f( W ) - r(^))^ 1 

<C(l + |X r(w) |*V /2A1 , 



if /3 > 0, 
if /3 > v. 
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Thus, let E u = E m(jr0) ^'" ){ui) , we see 

E u [V(tj , x%?°' f, & ) - V(t, X* _! Xo ' Ti a )] 
<E" [(7(1 + |X T (w)|" + |X f H|f - r(^)| 5 / 2 + C(l + |X T (w)r + \X f \ r )\X f - X t {uj)\ s 
<C(1 + |X T (w)r + E w |X f r)e 5 / 2 + CE" [(1 + |X r (w)P + \X^)\X f - X t [oj)\ 5 ] 

<C(1 + \X T {u)\»)e s ' 2 + C (e" [(1 + |X T MP + |X f _n P ') VP (e<" [|X f - X T (u;)|*] P ) VP 
(where p = fi/S > 0, and 1/p+l/p' = 1) 

<C(1 + \X T {u)\»)e s / 2 + c(l + \X T (u)p + (E w |X f _r') VP ^ (E W |X? - X T (w)|")' 5 ^ 

<C(l + \X T (uW)e &/2 +C(1 + |X T (w)H (1 + |^r( w) r) 5/AI e (l//2A1) - 
<C(1 + |X T (w)|^)e 5 / 2 + C(l + I-XtHH e ( " /2A1) l 
Taking expectation, we get 



E 



<C(1 + E|X r |^)e ,5/2 + C (1 + E|X T | M ) e (l//2A1) M 
<C(1 + M^e 5 / 2 + C (1 + |xo|") e ( " /2A1) l 

The last inequality follows from Corollary 3.7 in Tang & Yong [34] . 

With these two bounds, and taking e — > 0, we get the desired inequality and the DPP. 



□ 



3.2 Preliminary Results 

To analyze the value function, we also need some preliminary results, in addition to the DPP. 
Lemma 4. The set 

E(x, t) := {£ G R" : MV(x, t) = V(x + £,t) + B(£, t)} 

is nonempty, i.e. the inftmum is in fact a minimum. Moreover, for (x,t) in bounded B' C R n x [0,T], 
{(y,t) : y = x + £, (x, t) € B' , £ G i)} is also bounded. 

Proof. This is easy by B(£,t) >L + C\£\», -C <V< C(l + |a;| 7+ ' 5 ), and ^ > 7 + S. □ 

Lemma 5. (Theorem 4.9 in Assume that d^Mif 6 Cg c (E n x (0,T)). J/ -u t + Lu = f in C in 
the viscosity sense, then it solves the PDE in the classical sense as well, and u(x,T — t) G 2 (C). 

Lemma 6. The value function V and MV satisfies V(x,t) < MV(x,t) pointwise. 
Lemma 7. MV is continuous, and there exists C such that for any x,y G K n , s < t, 

\MV(x,t) - MV(y,t)\ <C(1 + \x[< + \y\^)\x - y\ s , 
MV(x, t) - MV(x, s) <C(1 + \x\")\t - s\ s/2 . 

Proof. First we prove continuity. For each £, V{x,t) + B(£,t) is a uniformly continuous function on 
compact sets. And since S(x, t) is bounded for {x, t) on compact sets, taking the infimum over £ on some 
fixed compact sets implies that MV is continuous. 
For the Holder continuity in t, let £ G S(x, s), then 

MV(x,t) - MF(x,s) 
<t/(x + £, i) + i) - V(x + S,s)- B(& a) 
<C(1 + |x| M )|i-s|' 5/2 , 

given that s) > t) for s < t. □ 
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As a consequence, the continuous region C is open. 
Lemma 8. Fix x in some bounded B C W 1 . Let e > 0. For any 

£ G S e (x, t) = {£ : V> + £, t) + B(& *) < MV(i, *) + e}, 

we have 

V(x + £,t)+K -e<MV(x + £,t). (11) 

In particular, LetC K l 2 = {(x,t) el"x [0,T] : V(x,t) < MV(x, t) — K/2}. Then if £ G S K / 2 (x,i), i/ien 

Proof. Suppose £ G 3 e (x,?;), i.e. 

V(a; + £, t) + t) < MV(x, t) + e. 

Then, 

MV(x + £,*)= inf y (x + £ + i) + 5(r?, t) 

= inf V(x + £ + T), t) + B(Z + r], t) - B(£ + T],t) + B(t], t) 
v 

> inf V(x + £ + v, t) + B(£ + r],t)- B(£, t) + K 
v 

= inf V(x + if, t) + B(rf,t) - t) + # 

=MV(i,t) + # 

>F(x + £,t) -e + K. 

Let e = IT/2, we get that £ G E K ^(x, t) implies x + £ G C A ' /2 . □ 

Lemma 9. MV is uniformly semi-concave in x, and MVt is bounded above in the distributional sense 
on compact sets away from t = T . 

Proof. Let A be a compact subset of K™ x [0, T — 8]. For any £ G S(x, i) for (x, t) G A, (x + f, t) lies in 
a bounded region £? independent of (x,i). For any |y| = 1 and <5 > sufficiently small, 

MV(x + 5y, t) - 2MV(x, t) + M{x - Sy, t) 



< 



28 

(V(x + 6y + £,t)+ gfe *)) - 2(V(x + + B(£, t)) + (V(x -6y + £,t)+ gfe t))) 

2(5 

V (x + <% + f , t) - 2F(x + + V (x - <fy + £, i) 



2(5 

<C||L>V|| BnC * /:! , 
which is bounded by Lemma [5] Similarly, 

MV(x, t + 8)- MV{x, t) 



< 



8 

V(x + £, t + 8) + B(f , * + (5) - (V(x + £, *) + £(f , i)) 



V(x + e, t + 8) - V{x + £,t) B{t-,t + 5) - B(£,t) 



8 

<C\\V~t\\ B nc K / 2 - 



□ 
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4 Value function as a Viscosity Solution 



In this section, we establish the value function V(x, t) as a viscosity solution to the (HJB) equation in 
the sense of pQ. 

Theorem 2. (Viscosity Solution of the Value Function,) The value function V(x,t) is a continuous 
viscosity solution to the (HJB) equation in the following sense: if for any 4> £ C 2 (M" x [0,T]), 

1. u — <j) achieves a local maximum at (xo,to) G B{xo,9) x {to, to + 9) with u{xo,to) = <p(xo,to), then 
V is a subsolution 

max{-<£ t + L<t>-f- ll[4>] - Ig[u],u - Mu}(x ,t Q ) < 0. 

2. u > <f> and u — (f> achieves a local minimum at (xo,to) G B(xq,9) x [to, to + 9) with u(xo,to) — 
cj)(xo,to), then V is a supersolution 



max{-<k + I4-f-ll[4>] -I 2 g [u],u-Mu]{xo,to) > 0. 



Here 



il[4>]{x,t) 

I 2 e [u]{x,t) 



4>(x + z,t) — <f){x, t) — D(j)(x, t) ■ zl| z i<i, p(dz), 

i 

u(x + z, t) — u{x, t) — D(f)(x, t) ■ zl\ [Z \ < ip{dz) , 



with the boundary condition u = g on 1" x {t = T}. 

Proof. First, suppose V — <j) achieves a local maximum in B{xo, 9) x [to, to + 9) with V(xo, to) = 4>(xo,to), 
we prove by contradiction that (— (j> t + L<p — Ig[(f>] — Ig[V] — f)(xo, to) < 0. 

Suppose otherwise, i.e. (— (f> t + L(f> — Ig[(f>] — Ig[V] — f)(xo,to) > 0. Then without loss of generality 
we can assume that —<fi t + Lcf> — Ig [<fi] — Ig [V] — f > on B(xo , 9) x [to , to + &)• Since the definition of 
viscosity solution does not concern the value of cj> outside of B(xq,9) x [to, to + 9), we can assume that 
(f> is bounded by multiples of |V|. Let X a = X x ^ to '°°' and 

t = in£{f e [t , T]:X t <£ B{x , 9) x [* 0) t + 9)} A T. 

By Ito's formula, 

E[^(X°,r)] -4>(x , t ) =E 
Meanwhile, by Theorenfll 



b t -Ld, + ll[^\+lM){X s _, S )d S 



to 



V(x ,t )<E / f(X° s ,s)ds + V(X°,T) 
Combining these two inequalities, we get 

E [V(X a T , r)] - E [ / (<p t -L<f> + I x 6 [cj>] + / e 2 M)(X s °_, s)ds 

-J to 

<E [4>(X° t ,t)] -e[ (\<l> t -L<f> + ll{ct>]+I 2 e [ct>]){X s _,s)d S 

-J to 

" f(X° s ,s)ds + V(X°,T) 



=<j>(x ,t ) = V(x ,to) < E 



That is, 



E 



(-0 t + L<i> - Il[4>] - I 2 g[4>] - f)(X a s _, S )ds 



to 



< 0. 
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Again by modifying the value of <f> outside of B(xo, 9) x [to, to+0), and since V < <p m B(xo,0) x [to, to+0), 
we can take a sequence of (f>k > V dominated by multiples of \V\ such that it converges to V outside 
of B(xo,0) x [to, to + 0) from above. By the dominated convergence theorem, Ig[4>] converges to ig[V]. 
Thus, 



E 



/ + Lcb - l\ [4>] - I 2 e [V] - f) (X° s _ , s)ds 



<o, 



which is a contradiction. Therefore, we must have (— <pt + L<fi — 1} [<f>] — I$[V] — f)(xo, to) < 0, and since 
V < MV, we have max{-0 t + L4> - J^[0] - I 2 [V] — f,V — MV}(x ,t ) < 0. 

Next, suppose V — <f> achieves local minimum in B(xo,9) x [to, to + 0) with V(xo,to) = (j){xo,to)- Then 
if (V — MV)(x ,to) = 0, then we already have the desired inequality. Now suppose V — MV < — e < 
and — <fi t + L<j> — Ig[4>] — Ig[V] — / < on B(xq, 0) x [to, to + 9). Assuming as before that <f> is bounded 
by multiples of |V| outside of B(x o ,0) x [to, to + 9). By Ito's formula 



E[<f>(X°,r)] -<f>(x ,to)=E 



f -L^ + I}[4>] + lt[V])(X° s _,s)ds 

J t 



Consider the no impulse strategy r* = oo and let X Q = x to ' Xo '°°> . Define the stopping time r as 
before, i.e, 



t = mi{t £ [t ,T] : X t £ B(x , 
Then for any strategy (Tj,£j) G V, 

J[to,Xo,Ti,£i] 
fTiAr 



[to, to + 0)} A T. 



=E 
>E 



>E 



/ 1 f(s,X t s "^^)ds + B(r 1 ,^)l {Tl < TATl} + J[n At,X 

J to 

[ TlAT f(s,Xl°'*°' ^)ds + l {Tl < T} (B(r u ^) + V(X^^%r^ 

J to 

TL[l {Tl>T} V(X?V'*',Tj\ 
f 1 ' /(*, X° s )ds + l {ri < r} MV(X° , Tl ) 

J to 



ti At > 'u S«J 



+ E[l {ri>r} y(A r ,r)] 



>E 



r r /(a i >+n<Ar,nAr) 



e • P(n < t) 



>y(i ,a;o) + e-P(n < r). 



Therefore, without loss of generality, we only need to consider (rj,£j) € V such that n > r. Now, the 
Dynamic Programming Principle becomes, 



u(x ,to) = E 
Now combining these facts above, 

E [V(X°,t)] -E 



[ T f(X°,s)ds + V(X° T ,T) 

J to 



!\<i>t -L<f> + IM + i 2 g mx^, S )d S 

Jto 

>E [<t>( X° T , r)] - E [ f (4> t - Lcj) + I] [4>] + I 2 e [4>] ) (X° s _ ,s)ds 

Jt 



=4>{xo,t ) = V(x ,t ) = E 



f(X°,s)ds + V(X°,r) 



to 



E 



f T (-<k + Lcj>- I}[4>] - IM - f)(X s _,s)ds 

Jt 



> 0. 
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Again by modifying the value of <\> outside of B(xo, 0) x [to,to+0), and since V > <j> in B(xq, 6) x [to, ta+ff), 
we can take a sequence of 4>k < u dominated by multiples of |V| such that it converges to V outside 
of B(xo,6) x [to, to + 8) from above. By the dominated convergence theorem, Ig[<f>] converges to if [V]. 
Hence 



E 



ifa] - I 2 g [V] - f)(X°_, s)dt 



>0, 



which contradicts the assumption that (—<pt + L<f> — Ig[<fi] — Ig[V] — f)(xa, to) < 0. Therefore, max{- 
L^-I^-I^V]- f,V -MV}{xo,to)>Q. 



□ 



5 Regularity of the Value Function 

To study the regularity of the value function, we will consider the time-inverted value function u(x, t) — 
V(x,T — t). Accordingly, we will assume that a^, bi, f, B and j are all time-inverted. This is to be 
consistent with the standard PDE literature for easy references to some of its classical results, where the 
value is specified at the initial time instead of the terminal time. 
The regularity study is built in two phases. 

First in Section 15.11 we focus on the case without jumps . We will construct a unique W^^ ,p 
regular viscosity solution to a corresponding equation without the integro-differential operator on a fixed 
bounded domain Q T with Q T = B(0, R) x (5, T] for R > and 8 > 0, 

max{« t + Lu - f, u — = in Q T , 
u(t,x) = (j> ohOpQt- 

in which (j)(x,t) = V(x,T — t) and ^>(x,t) = (Mu)(x,t). The local uniqueness of the viscosity solution 
then implies that this solution must be the time-inverted value function, hence the W[^' p smoothness 
for the value function. 

Then in Section 15.21 we extend the analysis to the case with a first-order jump and establish the 
regularity property of the value function. 

5.1 Wfoc Regularity for cases without jumps 

The key idea is to study a corresponding homogenous HJB, based on the following classical result in 
PDEs. 

Lemma 10. (Theorem 4.9, 5.9, 5.10, and 6.33 of JE$ ) Let a G (0,1]. Assume that a,ij,bi,f G 
C* 0+a ' 0+ t(Q^), a tj is uniformly elliptic, (j) G C 0+Q ' 0+ f (d P Q T )- Then the linear PDE 

u t + Lu = f in Q T ; 
u = (j) on OpQt- 

has a unique solution to \13]) that lies in C 0+a ' 0+ % (Qt) H C^ c a ' 1+ 2 (Qt)- 

Indeed, given Lemma HU1 let uq be the unique classical solution to (fT5)) . with the boundary condition 
<p(x,t) = V(T — t,x). Then, our earlier analysis (Lemma [3]) of Holder continuity for the value function 
implies that V(x,T — t) —Uo{x,t) solves the following "homogenous" HJB, 

max{ut + Lu, u — ^} = in Qt, 
u = on 8pQt- 

for ¥ = * - u Q . Since V < MV, we have *) = (*- u )(x, t) = (MV - V)(x, T - t) > on d P Q T - 
Therefore, our first step is to study the above "homogenous" HJB. 
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Step I: Viscosity solution of the "homogenous" HJB 



Theorem 3. Assume 



1. aijM,* eC°+<*'°+f(Q T ), 

2. (dij) uniformly elliptic, 



3. W is semiconcave, 



4- i&t is bounded below, in the distributional sense. 



Then there exists a viscosity solution u £ W^ 2,1 ^ ,p {Qt) to the homogenous HJB 



{ 



max{u t + Lu, u — = in Qt, 
u = on dpQx- 



(14) 



In fact, u £ W^ P (Q T ) for any p > 1. 

To prove this theorem, we first consider a corresponding penalized version. For every e > 0, let 
(3 e : K -> R be a smooth function such that f3 e (x) > -1, (3 e (0) = 0, j3' > 0, f3" > 0, < C/e for 

£ > 0, f3' e (0) = 1/e and as e — » 0, (3 e (x) — > oo for x > 0, /3 e (ir) — ^ for x < 0. One such example is, 
(3(x) = x/e for x > and it smooth extension to a; < 0. We see that there is a classical solution u to the 
penalized problem, assuming some regularity on the coefficients a lJ , b l , ty. 

Lemma 11. Fix e > 0. Suppose that a lJ , 6%\& s C 2+a ' 1+a / 2 ((5 T ), and (a 1 - 7 ) is uniformly elliptic. Then 
exists a unique u e C 4+a ' 2+a ^ 2 (Q T ) such that 



Note that Friedman [IB] proved a similar result for a W 2,p solution for the elliptic case using the 
L p estimates. He then used the Holder estimates to bootstrap for the C 2 regularity. Our proof is more 
elementary using only the Schauder estimates. (For details, see Appendix B). 

Next, consider the case with C a,a l 2 {Q T ) coefficients. We will smooth out the coefficients first to 
the above result, and then let e — > 0. More precisely, let (a 6 ) 1 - 5 , (b e )\ ^ € C°°(Q T ) be such that they 
converge to the respective function in C a,a ^ 2 (Q T ) and '5 > on dpQr- This is possible because ^ > 
on dpQx- Define L e to be the corresponding linear operator and u e to be the unique solution to 




(15) 




(16) 



Now we establish some bound for /3 e (u e — '5 ), in order to apply an LP estimate. 



Lemma 12. Assuming ^ is semiconcave in x, i.e. 



<9 2 * 



(17) 



for any direction |£| = 1, and 




(18) 



where both derivatives are interpreted in the distributional sense. We have 



l&K-* e )| <C, 



(19) 



with C independent of e. 
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Proof. Clearly /3 e > — 1, so we only need to give an upper bound. The assumption above translates to 
the same derivative condition on mollified W , which can be interpreted classically now. Thus we have 

% + L e W > -C. (20) 
Suppose u e — ^ achieves maximum at (xo,to) G Qt, then 

( u « _ W) t + L'(u e - T)(xo,t ) > 0. (21) 

Hence 

-/3 e (u £ -~V € )(x Q ,t ) = (u\ + L € u e )(x 0l t ) (22) 

> (W t + L e W)(x ,t ) > -C, (23) 

in which C is an upper bound independent of e. On the other hand, if it achieves maximum on dpQx, 
we get u £ — ^ < since * > on dpQr- Either way we have an upper bound independent of e. □ 

Now with this estimate of the boundedness of (3 e (u e — \& £ ), we are ready to prove Theorem [3] 

Proof. Lemma IT2l allows us to apply LP estimate: 

\\u*\\ w w, p{Qt) < C||/3 e (u £ -**)\\lhQt) < C > ( 24 ) 
for p > 1. Thus there exists a sequence e„ — > and u e W^ 2,1 '' p (Qt) such that 

u e " u (25) 

weakly in W^ 2 ' 1 ' ,p {Qt)- For p large enough, there exists a' > such that u e — > u in C Q ,Q ^ 2 (Qt), so 
u e — > it uniformly in Q T . 

On one hand, since f3 e (u e — ^ ) < C, yet /3 e (a0 — > oo as x > 0, hence u < Suppose u — <p 
achieves a strict local maximum at (xo,ta), then u e — <j) achieves a strict local maximum at (xq,^) and 
(xQ,tg) — > (xo,t ) as e — > 0, then 

Um(&+Z e 0)(*o.*o) <liminfft(tt e (ar§, *§)-*(!§,<§)) < 0. 
So (0* + L0)(a;o,«o) < 0. 

On the other hand, if u — (f> achieves a strict local minimum at (xq, to), then u e — <f> achieves a strict 
local maximum at {xQ,t$) and (xQ,ig) — > (xa,to) as e — >• 0. If u(xo,to) < ^(xo^to)-, then for small e, 



lim(& + L e </>)(x ,t ) > limsup/? e (M e (4,^) -*(x§,t§)) > 0. 



Step II: Uniqueness of the HJB equation without jump terms 



□ 



Proposition 2. Assuming that a,j ;, &j, /, 4 r , / are continuous in Q T; and <f> continuous on dpQr, the 
viscosity solution to the following HJB equation is unique. 

max{u t + Lu — f, u — *} = inQ T , , 2fi x 
u{t,x) = (j> on dpQx- 

Remark. Note that this is a local uniqueness of the viscosity solution. We later apply 4>{x, t) — 
V(x, T — t) and *&(x, t) = (Mu)(x, t) to our original control problem. 
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Proof. Let W, U be a viscosity subsolution and supersolution to (j2"o) respectively. Then is clearly a 
viscosity subsolution to v t + Lv — f — 0, with W < VP. On the other hand, at any fixed point (xo,to), 
either U(xo,tQ) — ^(xq^q) or U satisfies the viscosity supersolution property at (xo,to)- 
Define 

W*{x,t) = W(x,t) + j^- 5 (27) 

for e > 0. Note that W e is still a viscosity subsolution of v t + Lv — f = 0. For fixed e, a, f3, define 

<f>(t,x,y) = W e (x,t) - U(x,t) - a\x - y\ 2 - fi(t - S). (28) 

Denote B = B(0,R). Suppose max^ t ^ g g W e (x,t) — U(x,t) > c > 0. There exist ao,(3o,£o, such that 
for a > ao, /3 < /3q, and e < eg, we have 

max x, y) > c/2 > 0. (29) 

(t,i,s)e[S,T)xBxB 

Let (i,x,y) € (<5, T) x £> x B be the point where $ achieves the maximum. Since $(<5, 0,0) < $(t, S,y), 
we get 

a\x-y\ 2 <h(\x-y\), (30) 

in which h is the modulus of continuity of U . Since the domain is bounded, a\x — y\ 2 < K for some fixed 
constant K independent of a, e,/3. We have \x — y\ < \J K/a, which implies 

a\x-y\ 2 <u(M). (31) 
V a 

Denote ui as the modulus of continuity of \E'. We have two cases: 
1. U(y,t) =~$(y,t). We have 

W'(x,F) <y( x ,t) + I ^ 

<u>(\x-y\) + $(y,t) + 
=u(\x-y\)+U(y,t) + 



t-S 
e 



t-6 
Thus 

W e (x,t)-U(y,t) <u(\x-y\) + 



t-S 

2. U(y,t) < ^(y,t). By the same analysis as Theorem V.8.1 in [15] . 

P<iu(a\x-y\ 2 + \x-y\). (32) 

Fix e < eo, j3 > (3q. For each a < ao, one of the two cases is true. If case 2 occurs infinitely many times 
as a — > oo, we have a contradiction, thus case 1 must occur infinitely many times as a — > oo. We have 
the inequality 

W t (x,t)-U(x,t)-f3(t-5) 
=<P(x,x,t) < $(x,y,i) 
<W\x,t)-U{y,t) 



<u(\ -h(J -)) + _. 
V a V a i — o 



Let a ->• oo, then W e (x,i)-E/(:E,i)-/3(i-(5) < Let j3 -t 0, then e -4 0, we get W(x, t) < f7(x,t). □ 

rem[3]and Propositior 

solution to (ITBl . we have 



Now, combining Theorem[3]and Proposition^ together with LemmafTUlfor the C (Qr)nC , , : ^t a ' 1+ 2 (Qt) 
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Step III: Regularity of the (HJB) equation without jump terms 
Proposition 3. Assume 

1. a t3 ,b t ,*e C 0+a - 0+ f(Q^), 

2. (aij) uniformly elliptic, 

3. $ is semiconcave, 

4- is bounded below, in the distributional sense, 
5. <t>£ C a+ ^ 0+a / 2 (Q T ). 
Then there exists a unique viscosity solution u G Wj^^' f (Qt) H C{Q t ) to the PDE 



max{u( + Lu — f,u— ^} — in Qt, 
u = (j) on OpQt, 



(33) 



for any p > 1 . 



Finally, since Mu(x,t) is semi-concave from Lemma [9j replacing ty(x,t) by Mu(x,t) gives us the 
regularity property of the value function. 

Theorem 4. Assuming p = 0, the value function V(x,t) is a W, *(B" x (0,T)) viscosity solution to the 
(HJB) equation with 2 < p < oo. In particular, for each t G [0, T), V(-, t) G C^'^IR") for any < 7 < 1. 

In fact, if one adds additional assumption of ay and bi in W / ^ 2 c ' 1 - ) ' 00 (R™ x [0,T]), then with more 

detailed and somewhat tedious analysis, one can establish W^' 1 '' 00 regularity for the value function. For 
more details, see Chen [5]. 

5.2 Regularity for Value Function of First-Order Jump Diffusion 

Careful checking of our analysis for the case without jumps in Section 15.11 reveals that we could relax 
our assumption on / to be bounded instead of Holder continuous, and take f e to be Holder continuous 
and converge to / in L°° . This observation is key for the regularity with jumps. 
To proceed, we will add two new assumptions in this subsection. 

Assumption 10. The operator I[<p] is of order-S, i.e, for (x,t) in any compact subset o/l™ x [O,! 1 ], 
there exists C such that 



\z\ s M(x,t,dz) < C < 



z\<l 



Remark. Since S G (0, 1], this implies that /i z i <1 \z\M(x,t,dz) < C. 

Assumption 11. The measure M{x,t,dz) is continuous with respect to the weighted total variation, 
i.e., for (x n ,t n ) -> (x ,t Q ), 

(\zp + \z\ 5 ) \M(x n ,t n ,dz)- M(x ,t ,dz)\ ->0. 

Proposition 4. With additional assumvtions 1 1 (A and \ 1 11 there exists a unique u G W (2 ^' P {Q T ) viscosity 
solution of the following equations, 

max{-ii( + Lu — f — Iu,u — MV} = in Qt, ( oa\ 
u = V(x,T-t) ondpQ Tl ( } 

in the following sense. For any 4> G C 2 (M™ x [0,T]) ; 

1. If u — (ft achieves a local maximum at (xo,to) G Qt, then 

max{-0 t +L<f>-f- I°[V],u- MV}(x ,t ) < 0; 
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2. If u — <f> achieves a local minimum at (xo,t ) e Qt, then 

max{-0 t + L<j> - f - I°[V],u - MV}(x Q ,t ) > 0. 

Here 

I°[V](x,t)= J V(x + z,t)-V(x,t)-Dct>(x,t)-zl lzl<1 p(dz), 
with the boundary condition u = g on R n x {t — T}. 

Proof. Let bi = hi — J ZiM(x 7 1, dz) and / = J u(x + z,t) — u(x, t)M(x, t, dz). It suffices to show that 6j 
and / are bounded. In fact we will show that they are continuous. 

Step 1, / is continuous: 

Let x n — > xq, then 



< 



+ 



For the first term, 



V(x n +z,t)- V(x n , t)M(x n , t, dz) - J V(x Q +z,t)- V{x , t)M(x , t, dz) 
j (V(x n + z,t)- V(x n ,t)) (M(x n , t, dz) - M(x , t, dz)) 

j (V(x n +z,t)- V{x n ,t)) - {V(x +z,t)- V{x ,t)) M(x ,t, dz) 



(V(x n + z,t)- V{x n ,t)) (M(x n , t, dz) - M(x , t, dz)) 
<C J (1 + \x n p + \z\-<) \z\ 5 \M(x n ,t,dz) - M(x ,t,dz)\ 



<C 



\z\ s \M(x n ,t,dz) - M(x ,t,dz)\ -> 0. 



For the second term, the integrand — > as n — > oo. So by the dominated convergence theorem, 
J (V(x n +z,t)- V(x n ,t)) - {V(x + z,t)- V(x , t)) M(x , t, dz) 
< J C(l + \x n \^ + \zP)\z\ 5 + C(l+\xo\^ + \zp)\z\ 5 M(x ,t,dz) 
<C J |z| 7 + \z\ 5 M(x ,t,dz) < oo. 
Therefore / is continuous in x. Now let t n — > to, 

J V(x + z, t n ) - V(x, t n )M(x, t n , dz) - j V(x + z, t ) - V{x, t )M(x, t ,dz) 
< J (V(x + z, t n ) - V(x, t n )) (M(x, t n ,dz) - M(x, t , dz)) 

J (V(x + z,t n ) -V{x,t n )) - (V(x + z,t ) - V(x,t ))M(x ,t,dz) . 



+ 



For the first term, 



J (V(x + z, t n ) - V(x, t n )) (M(x, t n , dz) - M(x, t , dz)) 
< J C(l + |a:|T + \zD\z\ s \M{x,t n ,dz) - M(x,t ,dz)\ 
<C J |z| 7 + \z\ s \M(x,t n ,dz) -M(x,t ,dz)\ ->• 0, 
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as t n — > to. For the second term, the dominated convergence theorem implies 



(V(x + z, t n ) - V(x, t n )) - (V(x + z, t ) - V(x, t )) M (x , t, dz) 
< I C(l + |a:p + \zp)\z\ s M(x,t ,dz) < oo. 



Therefore / is continuous in t. 
Step 2, bi is continuous: 

This follows easily from Assumption 1111 Let (x„,t n ) — ¥ (xo,to), 



f 

J\z\<l 



<l \z\\M(x n ,t n ,dz) - M(x ,t ,dz)\ 
\z\<l 

dz) - M(x Q ,t ,dz)\, 



z[M(x n ,t n ,dz) - M(x ,t ,dz)] 



which goes to as n — > oo. 

Step 3, replace bi by bi = bi — J ZiM(x, t, dz) and / by / = / + J u(x + z,t) — u{x, t)M{x, t, dz), and 
follow the same line of reasoning in the proof for Proposition [3J 

□ 

Notice, however, the "apparent" difference between the two types of viscosity solutions: the one in 
the above proposition, and the one in Theorem [5] Therefore, we need to show that the viscosity solution 
in Theorem [5] is also a viscosity solution of Eqn. (|3~i)) . Then, with the standard local uniqueness of HJB 
of Eqn. (|34|) . the regularity of value function is obtained. 

Theorem 5. V is also a solution of Eqn. [34]) , with additional assumvtions l 1 0\ and \ll\ 

Proof. Suppose V — (p has a local minimum in B(xq, Oo) x [to,t + 6q). Then we know that 

max{-0 f +L(j>-f-$ [</>] — Ig[V],V — MV} < 

for any < 9 < do. And with the additional assumptions, Ig[4>] + Ig[V] — > I°[V] as 9 — >• 0. Therefore we 
have 

max{-0 t + Lcj) - f - 1° [V],V — MV} < 
The other inequalities can be derived similarly. □ 
In summary, 

Theorem 6. (Tiegularity of the Value Function and Uniqueness^ With additional assumptions 
\10\ and \ll[ the value function V(x,t) is a unique W/ 2 C ' 1),P (K" x (0,T)) viscosity solution to the (HJB) 
equation with 2 < p < oo. In particular, for each t G [0, T), V(-, t) e C^^M") for any < 7 < 1. 



6 Appendix 

6.1 Appendix A: Proof of Lemma [2] 

Proof. First assume that H 2 d[M] is bounded and M is a L 2 -martingale. The conclusion is clearly 
true when H is an elementary previsible process of the form Zil( S . T .y Now let be a sequence of 
such elementary previsible process that converges to H uniformly on fl x (0, T}. Let N^ n) = f* Hi n) dM s , 
and N t = H s dM s . 

First we show that quadratic variation is preserved under regular conditional probability distribution. 
By Lemma [TJ Q t = M t — M tAT is a martingale. Consider the quadratic variation [Q] under P. By 
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definition, Q\ — [Q] t is a martingale. Thus by LemmaQ] for almost every w, Q 2 — [Q] t — (<3| At — [Q]*at) 
is martingale under (P|J>)(w). 

Q\ - [Q] t - (QfAr - [QW) 

=(M t - M tAr ) 2 - {[M] t - [M] tAT ) 

- ((M tAT - M tAT ) 2 - ([M] tAT - [M] tAT )) 

-q 2 - ([Af] t - [M] tAT ) 

This shows that under (P|7 r T )(w), [Q]f |;C ' t)( " ) = [M] t - [M] tAT . This allows us to simply write [•] instead 
of Hence, 



y i/ 2 d[M] = y i/ 2 ^^] 



is bounded under (P|J>)(o;). 
By the definition of H^, 



< lim inf 



lim inf I 



lim inf E^)^ 
E (P|^ T )(w) 



y J iffW-^.i a d[Q], 



£ - H s \ 2 d[M] s 



Thus, lim inf „ E^^) / t T |i?j nJ - H s \ 2 d[Q] s = for almost every u. On the other hand, 



lim inf E^^ [JV? -N T Y 



< lim inf E ff 



<liminfE lp [iVJ-A^ T ] 2 = 0. 



So we have 



□ 



lim inf RPWM UN n - N) T } 2 = 0, 

n 

for P-a.e. uj. This proves the claim. The general case follows from the localization technique. 
6.2 Appendix B: Proof of Lemma 1111 

Proof. Define the operator A : C 2+a ^ +a / 2 (Q T ) -> C 2+a > 1+a / 2 (Q T ) by the following: A[v] = u is the 
solution to the PDE 



ut +Lu + e (v - = on Q T , 
u = on dpQr- 



By the Schaudcr's estimates (Theorem 4.28 in |24j ) . we have, 



(35) 



||u|| c , 2+q , 1+q/2( q t) < C\\p e (v - ^)|| Cq , q/ 2 ( q t) 



<C e ll«-*l 



Thus the map ^4 is clearly continuous and compact. 
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The next step is to show that the set {u : u = XA[u],0 < A < 1} is bounded. Then we can apply 
Schaefer's Fixed Point Theorem (Theorem 9.4 in ([IS])- Suppose u — XA[u] for some < A < 1. Then, 

u t + Lu + \f3 e (u — 9) = on Q T , . . 

u = Q ond P Q T . ' 

Since 

||w]| C 2 + «,1+«/2 ( Q t) < C e \\v ~ *|| C «,a/2 ( Q T )) 

<C e (\\u\\ aa , a/a Q T) + \\^\ aa , a , a( Q T) ) 



Thus 



< i|| W |i c2+Q , 1+ . /2( Q r) + c e (\\u\\ c( Q T) + \\m c «.*/*(Q T ))- 



\\u\\ C2+0 ,, 1+a/2{ Q T) < C t {\\u\\ c( Q T) + \\V\\ Ca ,cc/2 ( Q T) )- (37) 



So we only need to bound u independent of A now. 

If A = 0, then u — 0. So we can assume that A > 0. Suppose u has a maximum at (xq, to) £ Qt- Then, 
-\p e (u(x ,t ) - V{x , t )) = («f + Lu)(x , t Q ) > 0, /3 e (u(x , t ) - *(x , t )) < 0, u(x , t ) < y(x , t ), 
and u = on dpQr- So we get u < \^\[l<*>{q t )- 

For a lower bound, consider the open set = {u < ^} in Q T . Since in Q, u t + Lu > 0, u > infg p o u. 
Yet, dpQ C 9pQtU{m > and in both cases u is bounded below. Thus we conclude that u is bounded 
independently of A, and ||w||l~(q t ) < II*IIl-(q t )- _ 

Now Schaefer's Fixed Point Theorem (Theorem 9.4 in [T3]) gives us the existence of u 6 C 2+a4+a / 2 (Q T ) 
that solves (IT5|) . Now we have — /3 e (u — ^) € C 2+Q ' 1+a / 2 ((3 T ). By the Schauder's estimates again, we 
have u G C 4+q ' 2+q/2 (Q t ). * □ 
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